Transmission of Information between Complex Networks: l//-Resonance. 
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We study the transport of information between two complex networks with similar properties. 
Both networks generate non-Poisson renewal fluctuations with a power-law spectrum 1// 3_M , the 
case /x = 2 corresponding to ideal l//-noise. We denote by [is and up the power-law indexes 
of the network "system" of interest S and the perturbing network P respectively. By adopting a 
generalized fluctuation-dissipation theorem (FDT) we show that the ideal condition of l//-noise 
for both networks corresponds to maximal information transport. We prove that to make the 
network S respond when (is < 2 we have to set the condition /ip < 2. In the latter case, if 
fip < fis, the system S inherits the relaxation properties of the perturbing network. In the case 
where [ip > 2, no response and no information transmission occurs in the long-time limit. We 
consider two possible generalizations of the fluctuation dissipation theorem and show that both lead 
to maximal information transport in the condition of l//-noise. 

PACS numbers: 05.40.Fb, 05.40.-a, 02.50.-r,,82.20.Uv 
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I. INTRODUCTION 

Linear Response Theory (LRT) flj is one of the ba- 
sic ways of obtaining information from fluctuations in 
non equilibrium statistical physics 0, H| that is currently 
adopted to address new phenomena such as glassy sys- 
tems [2j and granular matter [3j . An even more challeng- 
ing issue is the application of LRT to complex processes 
such as physiological processes and especially the under- 
standing of brain dynamics. 

It is becoming more widely accepted that the brain 
operates at criticality [3, [E| and that the critical condi- 
tion of a phase transition has manifestations that extend 
beyond the conventional condition of temperature driven 
systems [6] . Frantsuzov et ai. [7| adopted a model of co- 
operatively interacting units to propose a solution to the 
long-standing mystery of the origin of the power-law dis- 
tribution of the blinking times in colloidal quantum dot 
fluorescence. On the other hand, this form of intermit- 
tence is characterized by the condition of renewal aging 
Q and by the consequent ergodicity breakdown Q that 
makes it impossible to use conventional LRT. We refer to 
these systems as complex networks. It is now very well 
understood [l(| that the breakdown of the ergodic con- 
dition is caused by the occurrence of crucial events. The 
important fact that cooperation-induced phase transition 
turns a regular network into a complex network, namely, 
a network with temporal complexity and crucial events, 
has been proved in the recent work of Ref. [ll[. These 
events are renewal, namely, the time interval between 
two consecutive events does not have any relation what- 
soever with the earlier or later time intervals between 
two consecutive events. Yet, if a Gibbs ensemble is suit- 
ably prepared initially, namely, in all the networks of the 
ensemble an event occurs at the time origin, then the 



rate of event production turns out to be time dependent 
rather than constant as in the ordinary Poisson case. The 
authors of Refs. [H|,[I|[ applied this theoretical perspec- 
tive to the liquid crystal dynamics and experimentally 
realized a true cascade of renewal events. 

The time interval between two consecutive crucial 
events is given by a waiting times probability density 
function (pdf) ip( T ) with the following asymptotic form 



^(r) = ( M -l)- 



J7J- 



(1) 



(r + Tf- L 

and the power-law index fi fulfilling the inequality 

1 < (jt < 3. (2) 

It is important to explain the origin of the special form 
of Eq. (UJ). First of all we want to stress that according 
to a point of view in the field of complexity, only the 
asymptotic time behavior matters, namely, ip(r) cx 1/t m . 
The adoption of this widely shared point of view, as we 
shall see hereby, would prevent us from establishing a 
correct accordance with the experiments on the response 
of complex networks to external perturbations. Thus, 
the choice of Eq. (JT]) is dictated by the need for defining 
a border between the asymptotic time regime (r 3> T) 
and the microscopic time regime (t < T). Given the 
neurophysiology interest of this paper and especially the 
focus on brain dynamics, we refer the interested reader 
to the work of Ref. 14| , where the waiting times pdf of 
Eq . (UJ) is obtained by means of a Fechner transformation 
[14j from the conventional Poisson distribution. 

The rate of cascade of renewal events tends to a vanish- 
ing value as l/t 2 ~^ when /j, < 2 and to a constant value 
as l/t^~ 2 when /i > 2. It is evident that in both cases the 
time duration of the out-of-equilibrium condition is infi- 
nite, thereby raising the challenging task of going beyond 
conventional LRT to describe the dynamics. 
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Conventional LRT is given by the following expression: 



= (&(*)> = e / dax(t,«)£ P (s), 



(3) 



where £s (i) is the fluctuation produced by the network of 
interest S. The symbol (£s(*)) denotes the Gibbs aver- 
age over the fluctuations. In the absence of perturbation 
this average is assumed to vanish. The variable £p(i) 
denotes the time dependent perturbation and e its in- 
tensity. LRT predicts the response of S on the basis of 
the unperturbed correlation function of I n f &c t the 
function \(t, s), called the linear response function, is re- 
lated to the correlation function of the fluctuation £g, 
whose quadratic mean value is assumed for simplicity to 
be normalized to unity, 



by the following expression 



X (t,s) = ^s{t,s). 



(4) 



(5) 



Note that the traditional LRT refers to the stationary 
case 



and as a consequence 



£*s(t,-) = -|*sM. 



(6) 



(7) 



This condition is not fulfilled by complex networks. For 
these latter networks the choices of linear response func- 
tions 



X (t,s) = —Vs(t,s) 
as 



and 



X(t,s) 



dt 



9 s (t,a) 



(8) 



(9) 



are not equivalent. 

The authors of Refs. ff5l - fll| have discussed the foun- 
dation of both choices and have established that the new 
form of LRT is determined by the physical way through 
which perturbation determines a bias. For the sake of 
simplicity these authors have made the assumption that 
£s(i) is a dichotomous signal. Using the jargon of turbu- 
lence theory they called the time intervals between two 
consecutive crucial events laminar regions . At the mo- 
ment of a crucial event occurrence, unperturbed dynam- 
ics are realized by the random selection of either the pos- 
itive, £g = 1, or the negative value, £g = — 1. In other 
words, they assume that the occurrence of a crucial event 
generates the tossing of a fair coin which determines the 
sign of the next laminar region. Consequently, the ex- 
ternal perturbation can generate a bias in two different 



ways. The former way rests on affecting the fairness of 
the coin tossing process. If £p(i) > (£p(i) < 0) the 
choice of the positive (negative) sign is more probable 
than the choice of the negative (positive) sign. This pre- 
scription leads to the choice of Eq. ((5J and is denoted as 
phenomenological LRT. 

The experiments done by the authors of Refs. [HI, [l3| 
show that nature prefers Eq. ([§]), the dynamic LRT. 
What is the theoretical argument in favor of the dynam- 
ical theory? To afford a convincing answer to this im- 
portant question, let us go back to the special form of 
Eq. (p}. We note that we do not know the Hamilto- 
nian of our complex network, and we do not even know 
if a satisfactory discussion of the complex dynamics can 
be made using a Hamiltonian formalism. Let us assume 
that Eq. ((TJ) is a reliable representation for the distribu- 
tion length of the laminar region. In this case, a reason- 
able conjecture is that the external perturbation affects 
either /1 or T, or both parameters defining the form of 
Eq. ([T]) . We know that /x defines the network's complex- 
ity and emerges from the cooperative interaction among 
interacting units. A weak external perturbation is not 
expected to change the network's complexity. It is there- 
fore reasonable to assume that the external perturbation 
affects T, by enlarging (reducing) its value if £p and £s 
have the same (opposite) sign. This assumption leads to 
the choice of Eq. ©, as shown earlier |L5l - [l8| . 

It is important to notice that the response of a complex 
network of the same nature as the one discussed in this 
paper has been studied by many authors [l9l - l28l |. These 
authors did not establish a connection between their re- 
sults and the LRT of Refs. [l5l - fl8j and in some cases 
they made the misleading conjecture that their results 
establish the "death of LRT" . Actually, these theoretical 
treatments are asymptotic in time and the only possi- 
ble connection with LRT is through the adoption of the 
phenomenological theory of Eq. ((8]), as the readers can 
establish by a careful reading of Ref . [28j . 

We are now in a position to define the main purpose 
of this paper. We draw the attention of the readers to 
the recent results of Ref. [29I] . This paper addresses the 
important issue of studying the response of a complex 
network to a complex external perturbation with the sur- 
prising result that a complex network does not respond 
to stimuli that are not complex, i.e. that have a station- 
ary Fourier spectrum. It is important to stress that Ref. 
[29| focuses on the correlation between £g(i) and £p(t) in 
the long time limit. This is an ideal condition that has 
the effect of restraining the definition of complexity to 
the networks with [i < 2. In fact, in the long-time limit 
a network with /1 > 2 reaches the normal condition of 
a constant rate of event production, thereby recovering 
the ordinary Poisson condition. The condition /1 = 2 is of 
fundamental importance for brain function. In fact, re- 
cent work [13, EJ established that the brain works with 
fx = 2, which, in turn, is known [32j] to correspond to 
making the brain action become the source of ideal 1/ / 
noise. The results of Ref. [2t| may therefore have impor- 
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tant applications to design the most convenient stimuli to 
drive complex networks, and especially brain dynamics, 
via what was defined as "complexity management" [29l |. 
However, an apparent weakness of Ref. [2{| is that these 
results are derived from the adoption of the phenomeno- 
logical LRT, thereby raising the doubt that the complex 
networks, which have been proven to obey the dynamical 
LRT (13 , [13} , may not obey the principle of complexity 
management (CM) established in Ref. [29| . Herein we 
prove that the more realistic dynamical LRT generates 
CM. In addition to this main purpose, the present paper 
affords technical details on the theory developed in Ref. 
[2^ | that, due to space limitations, were not conveniently 
illustrated. 



II. A FDT FOR NON-ERGODIC RENEWAL 
NETWORKS: PHENOMENOLOGICAL AND 
DYNAMICAL APPROACH 

The authors of Ref. [HI, [r| discovered a form of FDT 
that applies to networks dominated by non-Poisson re- 
newal events. In the stationary case this FDT becomes 
indistinguishable from the ordinary theoretical prediction 

a- 

Herein we investigate the consequences of the adoption 
of either the " phenomenological" choice Eq. (8) or the 
"dynamical" choice (9), in the special case where both 
£p(i) and £s(£), are event dominated processes and show 
that the transmission of information from P to S is de- 
termined by the dialogue between the critical events of 
£s(t) and the critical events of £p(t). Specifically, this 
discussion is devoted to studying the transport of infor- 
mation from P to S, using both forms of generalized 
FDT (gFDT). Note that there is no limitation on the 
form of £p, provided that the coupling is weak enough 
as to be compatible with the emergence of the linear re- 
sponse form of Eq. (3). Thus, in this paper we imagine 
that P generates a fluctuating signal £,p(t) and that for 
any signal £p(i) there exists a response £s(i). We have a 
single composite network S+P and consequently a single 
signal £s(t). To discuss the problem of the transmission 
of information from P to S, it is convenient to imagine 
the ideal case of a Gibbs ensemble of networks S + P. 
For simplicity we take both signals £s(i) and fp(i) to be 
dichotomous and fluctuating between values ±1 

It is important to remark that Eq. ([3]) for the response 
of the "system" network S to the "perturbing" network 
P is valid when the network is prepared at time t = 
and the interaction with the perturbation P is turned on 
at the same time. Nothing is said about £p(i) because 
Eq. (3) is based on the assumption that for each perturb- 
ing signal we have to make infinitely many experiments 
and average over all possible responses. When the per- 
turbing signal is random, it is convenient to run Eq. (3) 
for infinitely many realizations of £p(t), and this, as we 
shall see hereby, will force us to prepare the perturbing 
network P as well as the perturbed network S. 



In the general case of a dicothomous renewal process, 
generated with a waiting-times pdf ip(t), the proba- 
bility density, that fixed a time t' , the first next event is 
observed at time t > t' is given [3J| by 

00 -t> 

i;(t, = m + V / i?(t")V(i - t")dt", (10) 

n=l Ja 

with 

00 

= (11) 

n=l 

where ip n (t) denotes the ro-times convolution of ip{t). 
R(t) is therefore the probability density of having an 
event occurring exactly at time t. It can be shown as 
well, see [Hj], that the auto-correlation function of the 
process is related to ip(t,t') by : 

/oo 
dx^{x,t') = *{t,t') (12) 

and therefore coincides with the survival probability 
fy(t,t') for the first event, i.e. the probability that, for 
fixed t' , no event is observed until time t > t'. We assume 
that the fluctuation generated by the network S is 
a dicothomous renewal process defined by the probability 
density 

T us-i 

M*) = 0*5 -1)^^. (i3) 

We therefore name respectively ips(t,t'), Rs(t) and 
^s{t, t') the functions obtained by replacing in Eqs. (fTUj) . 

dm and mm with ip s (t). 

Let us consider now the Gibbs ensemble of networks 
S + P, and evaluate the average (£s(i))sp. Note that the 
average is over the separate statistics of the two networks 
S and P 

{Zs{t)) 3 p = ((is{t))s)p. (14) 

We select all the responses to the same perturbation, 
characterized by a given £p(t), we evaluate their aver- 
age, denoted by (£s(i))s, and finally we construct the 
average over all possible perturbations denoted by (...)p 
so as to obtain the final result denoted by (...)sp- In 
conclusion with this procedure we obtain 

(*W> = «&(*)» = e f dt'x{t,t'){i P {t')), (15) 
Jo 

where for notational convenience we drop the subscripts, 
but we understand the averages in the sense described 
above. 

If necessary, the signal £p(t) must share the same prop- 
erties as £s(i) and for simplicity they are both assumed 
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to be dichotomous signals with random renewal fluctua- 
tions between the values +1 and —1. £p(t) is therefore a 
non-Poissonian dichotomic fluctuation with the following 
waiting-time pdf: 



ii>p(t) = (MP - 1) 



rpilp- 



(t + T P yp 



(16) 



ft is therefore convenient to define the additional func- 
tions ipp(t,t'), Rp(t) and ^p{t,t') obtained, analogously 
as done for the network S, by replacing in Eqs. (fTO]) . (fTTj) 
and (fT2")l the waiting time distribution tpp(t). The spec- 
trum of this type of fluctuating signal, in the absence of 
perturbation, as calculated in Refs. [32l. |33|. is: 



S(f) cx L"- 2 / A 



(17) 



valid for \i < 2, remarkably, even though a stationary 
auto-correlation function cannot be defined in this case. 
In the case fi > 2, S(f) = A/f 3 ~^, with A independent of 
L, the length of the sequence under study. At this point 
it should be clear to the reader that to get the important 
results of this paper on the transmission of the statistical 
properties of P to S, we must use Eq. (15). This leads us 
to give a prescription to define {£,p(t)). For simplicity's 
sake, we shall assume that the perturbing network P as 
well as the perturbed network S are prepared at t = 0. 
Thus, in Eq. (15) we shall replace (£p(i')) with ^ P {t'). 



III. PHENOMENOLOGICAL APPROACH 

In this section we study the response of a complex 
network producing non-poissonian renewal fluctuations 
to a perturbing network generating similar fluctuations 
within the phenomcnological approach. We analyze both 
the average response and the input-output correlation, 
i.e. the correlation between the perturbing (input) fluc- 
tuating signal and the signal produced by the "system" 
network (output). In the phenomenologic approach, 
the waiting times between the events generating the di- 
chotomic fluctuations remain unchanged by the pertur- 
bation. The external perturbation introduces a bias so 
that when an event occurs the probability that the di- 
chotomic variable changes or keeps its value are slightly 
different. The function x(t, s) in this approach, is given 
by0,[ll: 



x(t,t') = 



dt' 



= R s (t')*s{t-t'). (18) 



The function ^s{t,t') is the auto-correlation function 
of £s(t), namely, the survival probability of age t' , and 
Rs{t) for the case of discrete signals considered here, is 
the rate at which events are produced by the network 5* 
prepared at t = 0, i.e. the bits per second encoded in 
£s(t). This rate is time independent only in the Poisson 
case. In the non-Poisson case it depends on time, thereby 
making \1/ s(t, t') non-stationary. The brand new survival 



probability * s (t) = * s (i, t'=0), is given by [IE El, El! 

V s (t) = (l+t/T s ) 1 -^, (19) 

from which the corresponding waiting-times pdf ips (t) = 
—d^s{t)/dt is derived. In the range of parameters 1 < 
Us < 3 considered here, it is known [loj that: 



Rs(t) 



Rs(t) 



sin 7r/is 



(T s /t) 2 -^ for 1< ^ < 2 



TS 



1 + (Ts/t) 



A»S-2 



(20) 

for 2 < [i s < 3, 

(21) 



with ts = Ts/{[J.s — 2) the mean value of tps{t)- 

When fis < 2 the experimental preparation of S in- 
duces a sequence of events, whose rate Rs tends to van- 
ish for t — > oo, yielding a perennial out-of-equilibrium 
condition, and an explanation of the death of linear re- 
sponse [181424I [28j as well. In fact, the response to a 
harmonic perturbation of frequency / is proportional to 
l/{ft) 2 -^ s In the case 2 < fi s < 3, on the con- 

trary, the preparation-induced cascade of events, in the 
limit t — y 00, becomes stationary and virtually identical 
to that of a Poisson process. The theoretical analysis of 
this paper is done in the asymptotic time regime. Thus, 
we refer to the case 2 < fi < 3 as stationary, in contrast 
to the non- stationary case /i < 2 of perennial transi- 
tion. Similarly to the rate of events Rs(t) the spectral 
intensity per unit time tends to vanish for fi < 2 as an 
effect of increasing L (see Eq. (fT7|) ). The ideal 1// noise 
condition, corresponding to /1 = 2, generates instead a 
logarithmic decrease of the spectral intensity with time, 
and consequently a spectrum virtually independent of L. 



A. Average response to perturbation. 

As previously mentioned, the non-stationary LRT 
(NSLRT) of Eq. rests on the preparation of S at 
time t = 0. We apply the same preparation condition 
to P, thereby generating the cascades Rs(t) and Rp(t) 
described by Eqs. (|2H)) and (f2"Tj) . with the appropriate 
indexing. Under this condition the relaxation of {£p(t)) 
becomes identical to the survival probability ^p (t). As- 
suming the condition of Eq. (|18p we have the following 
expression for the average response: 



<*(*)> 



Rs(t')^s(t-t')^ P (t')dt'. (22) 



The preparation of both S and P makes the average over 
many realizations of the response o~(t) to a given stimulus 
P vanish for t —> 00. 

Stationary case: 2 < ^5 < 3. 

In this regime a finite time scale for the fluctuation £5 
exists and Rs(t) reaches the constant value 1/ts- The 
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inverse power law relaxation of ^s(i) allows us to ap- 
proximate Eq. (j2"2")l by replacing Rs(t') with its value for 
t' ~ t, i.e.: 

(<r(t)> ~ e / df* s (* ~ t')V P (t')/T S , (23) 
Jo 

which becomes exact for t —¥ oo. The asymptotic behav- 
ior of Eq. (|23p is easily obtained in the Laplace domain: 

(^^ei 1 -^') 1 -^), (24) 

Ts S S 

which can be studied in the limit of small s. In fact, since 



i>(s) ~l-Ts + r( t i-2)s f *- 1 fi>2 



and 



tp(s) ~l + r(p-2)i 



(25) 



(26) 



it follows that for 1 < fip < 2 and 2 < \ip < fig, the 
time-asymptotic behavior is (o~(t)) ~ t ^ , which is pro- 
portional to (£p(i)) for large t, meaning that the system 
5 1 "inherits" the relaxation properties of the perturbation 
P. 

For 2 < /is < fip, instead, the asymptotic dominant 
term is (cr(t)) ~ t 1_Als , which is proportional to the ordi- 
nary unperturbed relaxation to equilibrium (£s(^))j when 
an initial bias for £s(£) is introduced. We see therefore 
that for fj,p < fig, when £p(i) is slower than £s(i), the 
perturbation imposes on the network its own relaxation 
properties thereby allowing one to "manage" the com- 
plexity of a network, by using an appropriate stimulus. 

Non-stationary case: 1 < < 2. 

In this regime, the network S violates the finite-time 
scale condition necessary for stationary dynamics and in 
fact Rs(t) cx t^ s ~ 2 , see Eq. (f20l) . With such replacement 
in Eq. (|2"2"j) , a convolution form appears which can easily 
studied via a Laplace transformation. In the Laplace 
domain (see Appendix A for details om coefficients): 



(&(s ~ 0)) ~ a s s» s - 2 +a P si- 



(27) 



which implies that if fip > 2 or if 1 < us < fJ-p then 
(a(t)) ~ t 1 -^ 3 . When 1 < fj, P < fj, s , we have (cr(i)) ~ 
^.i-ixp, Also in this case the perturbing network P forces 
onto S its own relaxation properties to equilibrium. 



fJ'Si Hp^ 


1 < fip < 2 


2 < ^ P < 3 


1<MS<2 
2</i S <3 


$oo = ({u s , hp)* I 

$oo = 1 HI 


$oo = II 
*°o - "f~ 2 i IV 

CS+MP-4 



TABLE I: Summary of the asymptotic values of the cross- 
correlation function 9?(t) in the phenomenological case. * 
SeeEq. ((ETTol) . 



Note that both Eq. (|22j) and Eq. 1(28} depend on the 
survival probability of network P, but in the former such 
survival probability depends on the single time t' whereas 
in the latter it depends on both t' and t. We limit our- 
selves to report the results for the asymptotic value <J>oo 
of $(£). When £s(t) an d £,p(t) are not stationary, i.e. 
when 1 < < 2 and 1 < fi P < 2, Eq. ([28]). in the limit 
t — > 00, gives: 



C(ms, Mp) = r (Ms + - 2) x 



(29) 



3F2 [{fJ-p - 1,/ip - 1, /zp + us - 2}, {^p,^p}, 1] 
L(2 - / ip)F( M p) 2 r( Ats - 1) 

where 3F2 is the generalized hypergeometric function. 
For more details see Appendix A. In the case 2 < fip < 3, 
$00 is simply zero. 




FIG. 1: The asymptotic limit of $(t) is displayed for us, Hp £ 
]1, 3[. The vertex /i,g=/ip=2 marks the transition to a condi- 
tion of maximal input-output cross-correlation. 



B. Input-Output correlation function 

We study the cross-correlation (or input-output corre- 
lation) function between the network S and the stimulus 
P : C(t) = {{£s (t) £p (t))) which is also used as an indi- 
cator of aperiodic stochastic resonance [36j]. Multiplying 
both sides of Eq. © by £p(t) an d averaging over the 
fluctuations of the perturbation P we obtain: 

$(f) = <7(f)/e = / dt'R s (t')y s (t-t')*p(t,t'). (28) 
Jo 



In the case 2 < fig < 3, inserting into Eq. (|28|) expres- 
sion (|2"Tj) for Rs{t), leads to: 

$( t ) = / dt ^^'^ Vpfrt) = * s (0)*p(t,t) 
Jo r s 

-*s(i)<M*. 0) - jf* di^i - t) d * P M*\ (3°) 

where 'l's(i) is given by Eq. ([T9l) after replacing us with 
/is — 1. Eq. (13T3)) is exact for t ^> t s and for 1 < /ip < 2 
it leads to = 1, since both the second and third term 
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disappear for t — > oo and the first is trivially 1 in the 
same limit. For Eq. (f3TJ|) 2 < /ip < 3 it yields: 

$oo = 1 - (mp - 2)T^ P_2 T^ S_2 AT 4 -^-^ (31) 

r AT/Tp 2-tip , AT^O MS - 2 

xB ,^ s + Mp-4 = -, 

AT/T S ^tp + /i5 — 4 

where AT = \Tg — Tp\, B[x, a, b) is the incomplete Beta 
function and the upper (lower) choice of the parameters 
refers to the case T$ > (<)Tp. The final expression in 
Eq. (|3"T|) corresponds to the case T$ = Tp. Results are 
summarized in Table HI For illustrative purposes, we sup- 
plement Table I with Fig. 1, showing the 3D plot of 
the cross-correlation function in the same parameter 
range: Square II and square III correspond to the con- 
dition of minimal and maximal correlation, respectively. 
Intuitively it is so because of the difference of time scales 
between S and P in such regions. In III fluctuations £s(i) 
and £p(t) have a finite and an infinite time scale, respec- 
tively, thereby allowing £s(0 to adapt to the stimulus- 
induced bias so as to yield maximal correlation. In II the 
role of the time scales is inverted, the bias induced by P 
on the longer (diverging) time scale of the process £s(i) is 
asymptotically averaged out due to the many intervening 
switching events of £,p{t), producing no correlation. The 
vertex fig = pip = 2, representing a 1/ /-noise network 
under the stimulus of a l//-noise perturbation, marks 
the abrupt transition from vanishing (square II) to max- 
imal correlation (III). 



IV. 



DYNAMICAL APPROACH 



In this section we extend the analysis of the previ- 
ous section to the dynamical approach. Within such 
approach we derive both the average response and the 
input-output correlation function. 



A. Average response to perturbation 

Starting from the property 



<*(*)> = «&(*)», 



(32) 



obtained by averaging over the fluctuations of both net- 
works and using the dynamical condition of Eq. (9), one 
obtains: 

x (t,t') = ~j^ s (t,t')=Mt,t') (33) 
Eq. Q then becomes: 



Kt))=e / dt'Mt,t')(Zp(t'))' (34) 
Jo 

For simplicity we prepare the perturbation £p(t) at 
t = 0. To observe the influence of P on S, we select all 



the networks of the Gibbs ensemble where £p(0) = 1. In 
this case (£p(i')} is given by [HJ the survival probability 
^ P (t). Thus, Eq. ((34]) yields 



(ff(t))=e / dt'yj s (t,t')^ P (t'), 



(35) 



where ^p(t') is the survival probability for the process 



/oo 
dxipp(x) 



t + Tf 



(36) 



This slow decay corresponds to the probability that no 
perturbation event occurs up to time t. The network S 
evolves in time so as to reach a steady value that cor- 
responds to a constant perturbation abruptly applied at 
t = 0. However, during this process a perturbation event 
occurs that has the effect of suddenly changing the ex- 
ternal field. Thus, a(t) does not reach a steady value, 
but after reaching a maximum value will decay. Under 
the specific conditions discussed in this Section, the time 
asymptotic decay of (cr(t)) in Eq. ([33)1 has the same 
power- law index as that of survival probability ^p(t). 
We interpret this phenomenon as the transmission into 
S of the statistics of P. 

We explore again the whole range of parameters 1 < 
Ms < 3 and 1 < [ip < 3 respectively for the "system" 
network S and the perturbation P, depending on the val- 
ues of the power-law indexes /xSjMp characterizing their 
waiting-times pdfs. The value fi = 2 marks the transition 
from a finite to an infinite mean time, i.e. the transition 
to a a non-ergodic, non-stationary condition. In fact, 
while for /1 > 2 a mean time exists, a finite time scale 
can be defined and a stationary condition is reached, for 
M < 2 such condition is never achieved, not even in the 
infinite mean time. 

Stationary case: 2 < fis < 3. 

In this regime the waiting-times pdf ips (t) has a finite 
mean value rg. Therefore a finite time scale tc exist 
such that for t > t' > tc the following approximation 
corresponding to reaching a stationary condition, is valid 

a 

1 r°° q>Q(t-t') 

iPs(t, i') - - / dml> s (x - - '-, (37) 

T~S Jt T S 

where t$ = Tg/(fis — 2) is the mean value of ips(t)- 
Eq. (|37|) is exact for tc — > 00. We can also use Eq. 
(|3]) for the response in the case when the interaction is 
turned on at a later time tc , that we assume to be so 
large as to satisfy the approximation Eq. (1371) . using 
the following procedure. We introduce into Eq. ([3]) an 
effective perturbation which is turned on at time t = 
but is zero until tc, i.e. Cp (t) = 0(t — tc)£p(t — tc)- In 
this scheme we can assume that the "real" process £p (t) 
is prepared at time t = tc in a brand new condition. 
Time tc therefore corresponds to the age of the network 
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5. The average response (er(i)) of network S in this case 
reads: 

(<*(*)> = e [ dt'Mt,t')m'-tc)tp(t'-t c ))(m 



e / dt'^s{t,t')^ P {t' -t c ), 



and the approximation (|3T[) can be used to replace 
ips(t,t'). With the substitution r = £' — and after 
renaming t — tc bjs t back again, the average response of 
the network S of age tc reads: 

^| tc = /*dr*2(*ZZ0* J ,( T ) = * 5 (o)* J ,(*) 
- VsWp(0)-J dt'V s (t-t')-^* P (t'), (39) 



where ^s(i) is defined as: 

* s (i) = (l + £/T s p- 2 



(40) 



Eq. (f3T)|) is exact for tc — > oo and coincides with the ex- 
pression Eq. (|23|) obtained in the phenomenological case 
in the same regime. Therefore, in the limit t >> T$, T P , 
the same considerations apply, i.e. if 1 < fip < 2 



J 



and 2 < fis < fJ.p, the time-asymptotic behavior is 
(cr(i)) ~ t 1 ~ Alp , which is proportional to (£p(t)) for large 
t, therefore the network 5 1 always "inherits" the relax- 
ation properties of the perturbation. If 2 < /is < /ip, 
the asymptotic dominant term is (a(t)) ~ t 1 -! 13 , which 
is proportional to the ordinary unperturbed relaxation to 
equilibrium (£s(t)). 

Non-stationary case: 1 < fig < 2. 

Let us make the assumption that, although at time 
t = half of the S networks are in the state £s = +1 and 
half in the state £s = — 1 , all of them are at the beginning 
of their sojourn in the corresponding states. This is an 
out of equilibrium condition, corresponding to preparing 
the network at t = 0. The calculations are detailed in 
Appendix B. Using the dynamic theory we obtain 



(a(t)} ki(ns,^p) , k 2 {ns,f-p) 



(41) 



where the first coefficient is given by 

Tp^- 1 sin(7TMs)r(2 - /xs)r(l - MP + 



7iT(3 - /ip) 



(42) 



and the second coefficient is determined to be 



[sin(7r/i S )r(3 - M s)r(l - + /^)r(2 M <? - 3) - (2 - /ig)r(2/i S - mp - 1)] 
Tp^Ts^-VO^ - 2)(2 - Ms)r(3 - /is)i>s - Mp)r(2 M s - 3) 

I 



(43) 



In this range of parameters the dominant term is al- 
ways the first term in Eq. (|4"Tj) which, if \ip < (is, is 
also slower than the unperturbed relaxation to equilib- 
rium of £g. In the latter range, therefore, the network S 
relaxes to equilibrium inheriting the same properties of 
the perturbing network P. 

The result in Eq. (41) is of special interest since it 
discriminates between the two approaches in the non- 
stationary regime. It is this difference that allowed to 



determine that liquid crystals [13j follow the prediction 
of the dynamical approach. In fact, the phenomenologi- 
cal approach disregards the influence of the perturbation 
on the occurrence time of the S events [Hi, 28] , while the 
dynamical theory does not, thereby affording a criterion 
for information transport that we judge to be a more 
appropriate representation of the communication among 
complex networks with [i < 2. However, the equivalence 
between the phenomenological and the dynamic theories 
in the case when the network S is infinitely aged (i.e. for 
[is > 2), indicates that generalization of FDT given by 
Eq. ((9|), namely, the dynamical theory, becomes active 
only when the network S is in a far from equilibrium 



condition and begins drifting towards equilibrium. Al- 
though equilibrium is never reached when /i < 2, the cor- 
relation function ^s(t,t') tends to recover the property 
^fs(t,t') = ^s(t — t') that makes the phenomenological 
theory formally equivalent to the dynamical theory. 



B. Input-Output correlation function 

Herein we study the asymptotic limit of the input- 
output correlation function 



$oo = lim C(t)/e, 

t— »oo 



(44) 



within the dynamical approach. The input-output corre- 
lation function is again defined by the average over the 
fluctuations in both the S and P networks: 



C(t) EE <esf(f)Mt)>. 



(45) 



The asymptotic limit of C (t) is independent of the way 
the "system" network and the perturbation are prepared, 
so we can use the prescription leading to Eq. ([3]) obtained 
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assuming that both network S and perturbation P are 
prepared at time t — 0. We therefore use the same argu- 
ments as those yielding Eq. ([28} and, adapting them to 
the dynamic theory we obtain 

*(t) = C(i)/e = / dt'i> s (t,t')*p(t,t'). (46) 



Non stationary case I: [/>S < 2, /ip < 2. 

We use Eq. (14"6")) with the general expressions for 
ips(t,t') and %!p{t, t') as obtained through Eqs. (fTU)) and 
(fT2| . respectively. In this case, taking the limit f ^ oo 
yields (see Appendix B for details) 



simrfip 



Co = lim $(t) = - 
x F[{/i P - I, up - l,fi P 



T(hp +fis - 1) 



- Ms ~ 



- i)r( MP + i)r( M s - 

1},{Hp, HP + 



(47) 



Non- stationary case II: /is < 2, /ip > 2. 

In this case we can assume that, when the interaction is 
turned on, the perturbing network P has already reached 
a stationary condition, so that in Eq. (|4"6"f t/js(t,t') is 
given again by Eq. flTUJl but ^ P {t,t') = #p(t -*'), with 



tf P (t) = (1+t/Tp) 



(48) 



and this expression has to be directly inserted into Eq. 
(®. 

The power-law index /ip — 2 reflect the stationary con- 
dition realized with the preparation of the perturbation 
P at a time tp = —oo. In this case, we obtain 



lim $(t) = 0. 



(49) 



In the time asymptotic limit, the network S turns out to 
be independent of P in spite of the fact that at t = we 
switch on the S — P interaction. 

Stationary case I: [is > 2, /ip > 2. 

We again use Eq. (j46j) and assume that, when the 
interaction is turned on, the perturbing network P has 
already reached a stationary condition so that in (|4"rJ)) 
Vp(t,t') =-& P (t-t') with*p(i) given by Eq. (gHJ). For 
Ms > 2 a finite mean time rg of i/»(f) exists, therefore a fi- 
nite time scale tc oc rs exists such that for t > tc Eq. (j3"7) 
can be used again to approximate ips(t,t'). With such 
substitutions, the expression for the correlation function 
becomes asymptotically equal to the correlation obtained 
in the phenomenological approach in the same regime, i.e. 
Eq. (30), leading to the final result Eq. (|3"Tj) . 

Stationary case II: Ms > 2, /ip < 2. 

In this case again a finite time scale tc can be found 
such that the approximation in Eq. Q37p is valid. Thus, 
again Eq. (|4"oT) can be rewritten 



*(*) 



dt'i/>s(t,t')* P (t,t') 



f dt'l^s(t-t')}* P {t,t'). 



(50) 



This case is therefore equivalent to what obtained for 
the phenomenological case in the same range of param- 
eters. Again, in the asymptotic limit t — ► oo, the first 
term in Eq. (j50[) vanishes and after integrating the sec- 
ond term by parts, one obtains: 



$(t) ~ *s(0)tfp(i,t)-*s(*-*c)tfp(Mc) 



dt'V s (t 



tc 



^ d*p(t,t') 
' dt> 



(51) 



Ms; /"p-> 


1< /ip < 2 


2 < /i F < 3 


K/i 5 <2 
2</i s <3 


$oo = 1 HI 


$oo = II 
*T> — MS -2 -ry 



TABLE II: Summary of the asymptotic values of the cross- 
correlation function <&(t) in the dynamical case. * See Eq. 

Ha. 




FIG. 2: The asymptotic limit of &(t) is displayed for the 
different regimes of parameters for 1 < /is < 3 and 1 < /ip < 
3, in the dynamical approach. 

In the asymptotic limit the second term on the right- 
hand side trivially vanishes and also the third term side 
can be shown to vanish (see Appendix B). The only re- 
maining contribution in Eq. (1511) is given by the first 
term, which is exactly one. It follows: 



$«> = lim C(t)/e = l. 



(52) 



Let us make here a few remarks on these results. Of 
course in the absence of coupling, e = 0, which means 
that C{t) always vanishes. We switch the interaction on 
at t = 0. Thus, we always have the zero cross-correlation 
initial condition C(0) = 0. As an effect of switching on 
the interaction at t = we realize the condition C(t) ^ 0, 
for t > 0. However, we find that there exist special condi- 
tions (region II in Fig. 2) for which the cross-correlation 
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again goes to zero, asymptotically 

$00 = lim C(t)/e = 0. (53) 

t— ► oo 

This indicates that only in such conditions, the network 
S, after a transient, recovers the condition of statistical 
independence of the perturbation £p(i). The fluctuations 
£s with /is < 2 turn out to be statistically independent 
01 &(t) onrv when > 2. The environmental pertur- 
bation with Lip < 2, on the other hand, is characterized 
by the remarkable property of forcing the network S to 
respond, regardless of the value of Lig. 

Table II and the plot in Fig. 2 summarize such results 
and show the same qualitative properties observed for the 
correlation function in the phenomenological case, with 
the correlation functions for the two approaches being 
identical in squares /, II, IV. The condition of ideal 1/ f- 
noise, i.e. p,g = Lip = 2 marks the transition from a 
condition of zero to maximal correlation. 



V. FINITE RESPONSE AND 1 //-RESONANCE 

Herein we proceed to demonstrate that the intensity 
of the response a(t) to a single realization of the stim- 
ulus does not decay, if $oo 7^ 0. This demonstration, 
therefore, is valid for both the dynamical and the phe- 
nomenological approach, leading to a general result. Let 
us define with pt(£g) the probability that at time t the 
variable £s takes the value i = ±1 and with p t (Cs\£,p) 
the conditional probability for the occurrence, at time t, 
of a value £s=i= ± 1, given the occurrence of a value 
£p=j= ± 1. By definition, the non-vanishing $oo yields: 

C(t)= £ y'P*(&l&)Pt(&) ' *K. (54) 

We note that for t — > oo, on a time scale such that (£p(i)), 
which decays as (£p(0))i 1_Alp , is a second-order quantity, 
0(e 2 ), we have that: 

Pt (£ P ) = l/2 + 0( £ 2 ) (55) 

and 

*(t) = $oo + 0(e 2 ). (56) 

Thus, due to Eq. (|54|) and to the symmetry of the con- 
sidered dichotomous processes: 

Pt(m P )^l+i^. (57) 
In the same long-time scale, Eq. (l57l) yields: 

(<r(t)) ± =Y i p t ^ 3 \^ 1 )ici±E^ 00 , (58) 

i 

where the subscript ± indicates the value of £p at time 
t. Summing Eq. (|58p over the two values of £p, gives 



a total average null response, as expected. [But if the 
magnitude \a{t)\ of the response to a single instance of 
the input £p(i) is considered instead, its total average is: 

(W(t)\) = \ £<K*)I>± Z \ £ K ff W>±l - ( 59 ) 
z ± 1 ± 

where an equality holds if terms of order 0(e 2 ) are ne- 
glected. Thus when > 0, the response a[t) to a 
single instance of the input £p(i) does not die out and 
remains proportional to the stimulus intensity, no matter 
how large t becomes. Square III in both Figs. 1 and 
2, is the plateau region of maximal cross-correlation and 
response. Claims regarding the death of linear response, 
as in [19H281 ]. are therefore appropriate only in relation 
to the vanishing correlation of square II. The total aver- 
age response (cr(t)) always tends to vanish for t — > oo for 
reasons that do not imply a lack of response except in 
the case of square II. 

The reason for the striking difference between the re- 
sponse to a harmonic perturbation and the response to 
a non-ergodic stimulus is intimately related to the emer- 
gence of 1/ f noise and to its spectrum described by Eq. 
(fTTj) which assigns the weight S{f)/L = \/{fLf~^ p to 
the spectral component of frequency / of a non-ergodic 
stimulus. As a consequence, the stimulus generates, 
in time, lower and lower frequencies /, so as to keep 
l/(/L) 2 ~ MS (i.e. the response intensity to frequency / 
[18| ) finite, thereby yielding Eq. (f5!?|) . The death of lin- 
ear response [l9|-[28| is caused by the fact that stimuli 
with fixed frequencies cannot cope with the decreasing 
frequency of the cascade of events of Eq. (|20|) . 

We have afforded a compelling proof that the intensity 
of the single realizations of er(i), with /xg < 2, does not 
decay if the perturbation £p (t) falls in the same complex- 
ity basin (/ip < 2). This is the phenomenon of complexity 
management which allows to define the right stimulus to 
obtain a response from a network with non-ergodic prop- 
erties. Now we argue that 1// stimuli generate the max- 
imum information transport by looking at the mutual 
information 

i(t) = EP'(^)ft(^ICp)iogb t (ftl^)M(ft)]- (60) 

i,j 

Using Eqs. ([SHD, ([HD and (J57J) it follows that: 

I(t -> oo) ~ e^l (61) 

and the information transmission rate is obtained by mul- 
tiplying I{t) by the input rate [37| . given by Rp(t). If 
Lip > 2, Fig. 1 shows that <&oo < 1. Although square III 
in Figs. 1 and 2, indicates that all stimuli with /ip < 2 in- 
duce maximal correlation, pp < 2 corresponds to a stim- 
ulus with decaying events rate (input bits/sec) Rp(t). So 
even if a response is produced in this regime, the rate of 
information vanishes in time. Only at the crucial con- 
dition Lip = 2, of ideal l//-noise, does this algebraic 
decay becomes logarithmic, and, consequently, a steady 
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and maximal information transmission rate is achieved. 
This is the phenomenon that we call 1 //-resonance. The 
above consideration are valid for both the dynamical and 
phenomenological approaches, therefore we consider the 
condition of maximal information transmission achieved 
in the ideal 1 / /-noise condition, a fundamental property 
of l//-noise renewal processes. 



VI. CONCLUDING REMARKS 

The growing interest for the dynamics of complex net- 
works is shifting the attention of the researchers from 
the synchronization of two stochastic units 13911 to the 
synchronization of a large number of units [40j, an in- 
teresting phenomenon that is closely related to the very 
popular model of Kuramoto [4lj . The single units of 
the processes of chaos synchronization are chaotic and 
do surprisingly synchronize while maintaining the erratic 
dynamics that they have in isolation. Although the single 
units of the Kuramoto model are regular, it is becoming 
increasingly evident that the emergence of a global syn- 
chronization is a condition independent of whether the 
single units are regular or stochastic. The single units of 
the work of Refs. [ill, EH are Poisson processes and if 
one of them drove the other, they would obey the prin- 
ciple of aperiodic stochastic resonance (43|. If the two 
units are bi-directionally coupled they are expected to 
undergo a condition of perfect synchronization if the cou- 
pling is sufficiently intense. When the number of inter- 
acting units is very large a phase transition occurs from 
the non-cooperative to the cooperative behavior [ll|, [42j ■ 
It is important to stress that at criticality no permanent 
consensus is reached, and the mean value of the global 
field vanishes. Yet, this condition is strikingly different 
from the non-cooperative condition. The whole network 
remains in the "yes" ("no") state for an extended time 
before making a transition to the "no" ("yes") state. 

It is surprising that the phase-transition literature 
seems to have overlooked, with only a few exceptions 
[11 El 13, that the transitions from the "yes" ("no") 
to the "no" ( "yes" ) state occurring at criticality are the 
"crucial" events defined in Section fl] In other words, the 
time interval between two consecutive transitions is de- 
rived from a pdf that has the asymptotic time structure 
of Eq. ([!} with a power index fj, fit ting the inequality 
condition of Eq. @. Some authors [ill l42j argue that 
/j = 1.5 and others, @, releasing the condition that all 
the units share the same Poisson rate, generate a global 
condition with crucial events characterized by /i < 2, but 
significantly departing from the value /i = 1.5. Note that 
the theoretical arguments of Ref. [45[ , yield the mislead- 
ing impression that the crucial value of /i is a consequence 
of ordinary statistical physics. 

According to some authors 0, H?} the Kuramoto phe- 
nomenon can be defined as inner synchronization. A 
network of cooperating units located on the nodes of a 
complex network may reach inner synchronization with 



different values of the control parameter, depending on 
the network topology [Hj]. This is a subject of increas- 
ing interest with attractive applications to the dynamics 
of the human brain [46| . If we adopt this perspective, 
we can address the problem of information transmission 
from one to another complex network as a process of 
outer synchronization. This is an interesting issue, but 
the conditions to fulfill to realize outer synchronization 
are not yet clear [46j . 

An important result of this article is the discovery of 
a promising road to settle the problem of information 
transmission from one to another complex network. In 
fact, if the inner synchronization corresponds to a crit- 
icality condition and criticality generates crucial events 
with a power-law index \x fulfilling the inequality of Eq. 
(J2|), then a complex network at criticality is a generator 
of 1// noise, with S(f) cx 1// 3_M . Thus the problem of 
information transmission from one to another complex 
network becomes equivalent to the phenomenon of 1/ f- 
resonance illustrated in this article. This is essentially the 
main result of earlier work |29| . The main conclusions of 
Ref. 2j| are illustrated by Fig. 1, which is obtained 
using the phenomenological LRT. 

What are the limits of this earlier result? The experi- 
ments [l2l [l3l | yield support to the dynamical rather than 
the phenomenological LRT, thereby generating doubt 
that the results of Ref. [27], although very attractive, 
may not completely reflect reality. It is important to 
stress that phenomenological LRT is a natural conse- 
quence of adopting the asymptotic time perspective re- 
placing the waiting-times pdf ip( T ) °f Eq. (JXJ) with 
V>(t) oc 1/t m . This way of proceeding, although gener- 
ating the elegant mathematics of fractional derivatives, 
has as an ultimate effect the misleading discovery of the 
death of linear response [191 - I241 . [28j . We do not adopt 
the asymptotic time perspective but the special form of 
Eq. <[l|). This is not a unique way of connecting the long- 
time to the short-time regime. However, whatever form 
we adopt we are convinced that there will be a param- 
eter playing the same microscope role of the parameter 
T of Eq. (HJ). It is reasonable to assume that an ex- 
ternal perturbation may perturb either T or /x, or both 
of them. However, the perturbation of /i is incompat- 
ible with the assumption of a weak stimulus. In fact, 
fi is a consequence of the cooperation among the units 
of the network, and a perturbation may affect fi only 
if its strength is large enough to influence the interac- 
tion among the units of the network. Thus, an external 
weak perturbation can only have an effect on T, thereby 
making the dynamical LRT become the proper way to 
study the response of a complex network to a weak exter- 
nal stimulus, in accordance with the experimental results 

For these reasons, we can conclude that Fig. 2 is the 
original, and important, result of this paper. We hope 
that it may open the road to the dynamical solution of 
the problem of information transmission 50] from one to 
another complex network, a research topic that is still in 
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its infancy. 
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APPENDIX A 

In this Appendix we record more details about the 
derivation of both the average response (o~(t)) and the 
input-output correlation function in the case of the 
phenomenological approach. 

When we adopt the phenomenological theory, we ob- 
tain for the average response to external perturbation, 
in the non-stationary case (cfr. Eq. (27)) the following 
asymptotic expression: 



where the coefficient of the first term is 



&i(Ms,Mp) 



T(/j p - fi s ) T(l - fi P + (i s ) 



r(i - ^p)T(fi s ) r(2-/x P )r( Ms ) 

and the coefficient of the second term 



(A-2) 



r(^p - ms) 
r(i- MS )r( MP )- 



(A-3) 



Note the logarithmic corrections corresponding to us 
fip, with 



(a(t)} sin(Tr^s) logi A(fi s ) 



(A-4) 



and 



sin(7r/i S ) 



MS 



1 



- 2 7 -2V> L (Ms) 



-cos(tt^ s ) 

where 7 is the Euler's constant and if>L,(z) the logarithm 
derivative of the T function. These predictions are qual- 
itatively equivalent to the dynamical theory predictions 
with the assumption that the network S has been pre- 
pared in the very distant past. 

The general expression of the correlation function in 
the phenomenological approach is given by Eq. (28). 

Non-stationary case I: [is < "Z^p < 2. 

In this range the asymptotic approximation for the 
function R(t) defined in Eq. (fTTj) for both S and P is 



(A-6) 



The power-law properties of $ s(i), in the long time limit, 
shift the dominant contribution to the integral of Eq. 



(28) to the range t' ~ t, this allows to adopt the approx- 
imation (??) inside the integral. It follows 



, , siuttiis sm.7TUp 
~ — — x 



7T 7T 
ft 



[ T^- 2 m S {t-T)dT [ X^- 2 ^! 

Jo Jo 



(A-7) 
(t-x). 



Using a generalized Newton binomial expansion of the 
power-law form of the functions p (t) we obtain the fol- 
lowing expression: 



3(t) 



sm7r/i5 smirfip 



7T 7T ' — ' \ n 

n=0 



t'n+»r+»s- 3 y s (t-t')dt' 



v A-mpA (-1)" 



(A- 



(A-l) while the convolution with ^>s(t) m the integral, leads to 



d>(t) 



sm-Kfj,s sin7r^p A — MpA (~l) n 

" 7T 7T 4rJ \ n ) (t + TpY+^p- 1 

t n+^ P -i r(n + ^ P + /i S - 2)r(2 - Ms ) 



n + fxp - 1 



r(n + /Up) 



(A-9) 



where we have used the fact that for t large the main con- 
tribution to the integral comes from the range of values 
x < t < t and therefore the asymptotic approximations 
for Rs(t) an Rp(t) are justified. The limit for t — > 00 can- 
cel the time dependence and leaves a sum which leads to 
the expression of Eq. (jT7|) in the text. 

N on- stationary case II: fig < 2,/ip > 2. 

In this case the function Rp(t) tends asymptotically 
to a constant value and therefore it easy to see, follow- 
ing analogous procedure to the previous case, that the 
correlation tends to zero. 

Stationary case I: fis > 2, MP < 2. 

As mentioned in the text, from Eq. (30) it is enough to 
show that the third term on the right-hand side is zero. 
Such terms read as: 

Smnfip [ ^s{t-t')dt't'^- 2 ^ P {t-t') (A-10) 

7T Jo 

Using a generalized binomial expansion for both ^s(t) 
and *f?p(t) we get: 



*(*) 



sm7r/ip 



E 



7r * — ' \ n 



1 - MpA A - Ms 



(-1)' 



(-1)' 



(t + T s ) 



m+fj.s—2 



t' n+m+tlp - 2 dt' 



m J (t + TpY'+^p- 1 
(A-ll) 



Carrying out the integration shows that the leading term 
in t vanishes for t —t 00 Such demonstration is valid also 
for the dynamical case in the same range of parameters 
(see Eqs. fl5T) and (l52"1)1. 
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APPENDIX B 

This Appendix is devoted to detailed calculations in- 
volved the evaluation of the asymptotic limits of the func- 
tion and (c(t)) in the dynamic approach. 

Herein only the parameter range hs < 2, Hp < 2 is 
considered, the other ranges being analyzed in detail in 
the main text and in Appendix A. 

<£"(£) is given by the following integral: 



with the same expression, with the respective parame- 
ters, being valid for Rp(t). Then we have 



Rs(T)lps(t-T)dT 



On the other hand 



{t + T s - t'y-^t'^- 1 sin(7r/i 5 ) 
?r(t + T s ) ' 



(B-l) 



where ips(t,t') is defined in Eq. JIDJ) and V P (t,t') in Eq. 
(12), each with the appropriate labeling. $(i) can be 
decomposed as sum of four contributions: 



Urir^rU -tuIt= it T ^, a „_ x x (B- 



E 



i-M (-)" 



(t + T P yi 
t' 



n ) (i + Tp)> 



/ R P (T)T n dT. 



i=l 



where 



$i(i) = tys(*)*p(*) 



(B-2) 



(B-3) 



t t' 



=■&?(*) / Rp(t")* P (t-t")dt"dt' (B-4) 




i 



^s(t) J {t-t")R P {t")*p{t-t")dt" 
b 



Using for Rp(t) the same approximation of Rs(t) Eq. 
(B-2), we have 



i? P (r)vMi - r)dr « - - 7 -^g-_ x ( B -9) 



7r(t + Tp)Mp- 



^ V n J(t + Tp)»n + /ip-l' 
The function 3>4(t) is 

sinTrupsinTTUg jms+mp-i ~ / f 

w 7T 2 {t + Tp t + T s )w ^ V t + Tp 



Z Z f 

<j> 3 (t) = *p(t) / / Rs(t")Mt - t")dt"dt' (b-5) A - mpA f ( n + MP + fIS ~ : 1; n + /ip + 





t 

- * P (t) Jit - t")R s (t")i>s(t - t")dt" 



t t' t' 

$ 4 (i) = J J J R s (t")i> s (t-t")Rp(T)^p(t-T)dt'dt"dT 





t+T s 



[n + pip - l)(n + /zp + us — 1) 
where -F (a, 6, c, z) is the hypergeometric function. Finally 



, sin^ M pr(/ip + Ms - l)(t + Tp) 1 -"'^ 

1*4 (I J « ~ T^T ttt: „, ; - ~ — — x 



(i - M p)r(/ip + i)T(ji s - i)(t + T s y*$-i>* 

{fi P - 1, fip - 1, fj, P + fj, s - 1}, {hp, hp + 1}, 



t 



t + T s 



(B-6) 



Here -05 (t) and ^fp(t) are defined in Eqs.(fT3|) and 
Using methods of Ref. [H, Eqs. (|B-4j) . (IB-5|) can be 
evaluated in the asymptotic limit to yield: 



where p F q ({a}, {&}, z) is the generalized hypergeometric 
function. In the limit for t — > oo 



Cl 



C2 



C3 



#*p- 



_ sin7r^pr(^p + /xg-l) 

*Poo — ; - — , - — . ~r X 



(B-10) 



Since in the limit t — > oo the three contribute vanish, it is 
not important the evaluation of the constants c\, c% % C3. 
To evaluate $4(i) we first need an analytical expression 
for Rs(t) and Rp(t). It can be shown that [4!| 



Rs(t) 



sin(7T^ s ) 1 
nT g 3 -i t 2-n s ■ 



(B-7) 



tt(hp - 1)T(hp + l)r(/x s - 1) 
F [{^p - 1, MP - 1) MP + MS - 1}) {mp, A*p + !}= 1] > 

As far as the evaluation of the function (cr(t)) is con- 
cerned, in the dynamic approach it is given by Eq. (|35[) : 



(<r(t))=e / il>s(t,t')* P (t')dt', 
Jo 



(B-ll) 
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which is to be evaluated in the parameter range /is < 
2, up < 2. Let P s (t) = R s (t) + S(t), Eq. (|rTTT|) reads: 

(<r(t)) = e/ dt'V P (t') [ dxP s {x)^s(t-x), (B-12) 
Jo Jo 

which, after a transformation on the integration domain, 
turns into 

(a{t)) = e[ dxi/> s {t - x)P s (x) [ dt'V P (t'). (B-13) 

JO Jx 

The long time limit shifts the main weight in the integral 
on the terms such that x < t. Therefore the approxi- 
mation Eq. (|B-7|) . valid also for Ps(t) in the long time 
limit, can be adopted. Inserting such approximation in 



Eq. flEDI leads to: 

~ -e^Lg* f 'dx1>s(t-x)x>»- 2 fdt>* P {t'). 

7TJ g JO Jx 

(B-14) 

After getting rid of the integral in t' by direct integra- 
tion of \I/p(t), one is left with a simple convolution which 
is easy to analyze in Laplace transform. After some 
straightforward algebra, extracting the two asymptotic 
leading terms, leads to: 

(a(t)) ~ + fc 2 ^ s " /lp " 1 (B-15) 

i.e. the asymptotic expression of Eq. (|4T|) . with the co- 
efficients given by Eqs. (JUJ and (j43]) . 
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